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teieop\rator system for manipulating objects 
a workspace at a 
:ntrol operator ' 



I CLAIM: 

i . 

located in a workspace at a worksite by an operator from 
a remote control operator's station comprising, 

manipulator meaVs at the work site including end 
effector neans for Lnipulation of an object at the 
workspace, 

controller means including hand-operated neans at 
the control station connected to said manipulator means 
for remote control of thi manipulator means by control of 
the hand-operated means by the operator, 

video camera means for viewing the workspace, and 
means responsive to\ the video camera means for 
oroducing an image of tAe workspace which image is 
"located adjacent the hand-cWated means for viewing by 
the ooerator in the directioAof said h^nd-operated means 
during operation of the hand4^at^4:,eans and providing 
the operator with a sense t&aAAe end effector means and 
hand-operated means are substantially integral 



A telecperator sys 



tern as deVined in Claim i wherein 



said video camera means comprise 



means for viewing 



he 



workspace from different 



angles for production ol 



stereoscopic signal outputs, 

said means for producing an JW.age comprising means 
for producing a 3-dimensicnal imagl of the workspace in 
response to said stereoscopic signa\ outputs. 



A telecperator system as defined \m Claim 2 wherein 
the angle between the optical axes Vf said means for 
viewing the workspace is substantia Aly equal to the 
operator's interocular viewing ancle of\ the image, 

4. A teleoperatcr system as defined in Vlaim -2 wherein 
said hand-cperated means comprises a control ncunt«d 
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for movement: in \ny pivotal direction, the image cf the 
end effector means and position of the movable control 
arm as sensed by tn v e operator providing the operator with 
a sense that the\ end effective means comprises an 
extension of the control arm. 
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5. A teleoperator system as defined in Claim 4 wherein 
said manipulator includes an arm mounted for movement in 
anv pivotal direction^ angular movement of the control 
arm by the operator producing substantially the same 
angular movement of the manipulator arm 
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6. A teleoperator system as defined in Claim 5 wherein 
the length of path from the eyes of the operator to the 
image of the workspace And^ength of control arm are 
related by a factor k to tAe d^ptical^th length from the 
video camera means to/ tkd workspace and length of 
manipulator arm, respect4>£Uy , where k is a constant. 



7. A teleoperator system as\defined in Claim 2 wherein 
said image viewable by the operator comprises a virtual 
image . 

20 S. A teleoperator system as defined in Claim 7 wherein 
said means for producing an imagi includes display means 
for producing a tc?-to-bottom Reversed 3 -dimens icnal , 
real image of the workspace, 

a mirror positioned in front \of the operator so as 

25 to receive the reversed real -image from the display means 
and to reflect the same toward the\ ooerator's eyes f 02 
viewing of said virtual image in th$ mirro: 



c. a teleoperator system as defined \ :r. Claim 3 wherein 
the disolay means is located above th\p mirror and races 
toward the mirror, 



• * 
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10. A telecperatcr system as defined in Claim 7 wherein 
the display means faces downwardly at an angle front 
vertical. \ 

11. A teleoperatW system as defined in Claim 1 wherein 
5 said manipulator \ means comprises first and second 

manipulators and said controller means comprises first 
and second hand-operated means for remote control of said 
first and second manipulators , respectively. 

12. A teleoperatcr\ system as defined in Claim 1 
10 including an endoscope\ comprising an operating section 

and an insertion sectioX insertable in a cavity in which 
the workspace is located and having observing window 
means through which the workspace is viewed by the video 
camera means. \ 

15 13. A telecperator system As/defined in^eflaim 12 wherein 
said manipulator means /incl^&^s^aj^ section and 

insertion section ihse^taAle in said cavity for 
manipulation of an object in \the cavity. 

14. A teleoperator system as defined in Claim 13 
20 wherein said manipulator means Acmprise first and second 
manipulators and said controlled means comprise first 
and second hand-operated means foA remote control of said 
first and second manipulators, respectively. 

15. A teleoperator system as defined in Claim 14 
25 including means for attaching the operating sections of 
the manipulators and endoscope to a\ support rail of a 
surgical table for support thereof during surgery. 

16. A teleoperator system as deAinec in Claim 1 
including force feedback from the manipulator means to 
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27 

he hand-cpe^ted means which, together with said image 
c: the workspace, provides for visual and force 
telepresence operation of the system. 
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17. A teleopefrator system as defined in Claim 1 
including first and second stereophonic microphones for 
picking up sounds from the workspace, and 

first and second speakers at the remote control 
station responsive td outputs from said respective first 
and second microphones for producing a stereophonic sound 
output and providing^ the operator with an audio 
Dersoective oresent at \the worksoace . 
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IS. A teleoperator system as defined in Claim 1 wherein 
said means for producing an image of the workspace 
includes display means f or\producing a real image of the 
workspace adjacent the hanp y<5oerfeted means for direct 
viewing by the operator. 



19. A teleoperator sVst^m\ as defined in Claim 1 
including an endoscope having i^n accessory channel, and 
wherein 

20 said manipulator means comprising a steerable 

catheter extending through the channel, said end effector 
means .being carried by said steerable catheter, said 
workspace being viewed by said videc\ camera means through 
said endoscope. 
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20. In a method of performing surgery\by an operator at 
a remote location which includes, 

inserting the insertion end of an Endoscope and of 
first and second manipulators into a subject, 

supporting the operating ends of the\ endoscope and 
first and second manipulators, 

employing said endoscope for viewxAg an ooject 



# # 
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inside the su&ject by video ca-era means, 

controlling said first and second manipulators by 
respective first and second hand-operated controllers 
remotely locateo from said manipulators, and 

presenting en image of the object viewed by the 
video camera means at a location adjacent the first and 
second hand-operated controllers for viewing by the 
operator during operation of the first and second hand- 
operated controllers and providing the operator with a 
sense that the fArst and second manipulators, and 
respective first and second hand-operated controllers are 
substantially intecr Al - 



21. In a method as\ defined in Claim 20 wherein a 
stereoscopic video camera is employed for viewing the 
jlo object by said endoscopy , _and 

wherein the imac^/\ presented ^i s a 3-dimensional 
image . 
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22. In a method as defined in Claim 20 which includes 
presenting a magnified imag^ of the object for viewing by 
the oDeratcr. 



23. In a method as defined in\ Claim 20 wherein the image 
viewed by the operator comprises a virtual image. 

24. In a method as defined in Claim 23 wherein the image 
viewed by the operator comprises\ a real image. 



25 25. In a method as defined in \ciaim 20 wherein the 
endoscope and first and second manipulators are inserted 
into the subject's abdomen, said method including 



>uf i xat mg 



n e a oc cm e n , 




